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Abstract 

Background: The potential of clinical practice guidelines has not been realized due to inconsistent adoption in 
clinical practice. Optimising intrinsic characteristics of guidelines (e.g., its wording and format) that are associated 
with uptake (as perceived by their end users) may have potential. Using findings from a realist review on guideline 
uptake and consultation with experts in guideline development, we designed a conceptual version of a future tool 
called Guideline Implementability Tool (GUIDE-IT). The tool will aim to involve family physicians in the guideline 
development process by providing a process to assess draft guideline recommendations. This feedback will then be 
given back to developers to consider when finalizing the recommendations. As guideline characteristics are best 
assessed by end-users, the objectives of the current study were to explore how family physicians perceive guideline 
implementability, and to determine what components should comprise the final GUIDE-IT prototype. 

Methods: We conducted a qualitative study with family physicians inToronto, Ontario. Two experienced 
investigators conducted one-hour interviews with family physicians using a semi-structured interview guide to 
1) elicit feedback on perceptions on guideline implementability; 2) to generate a discussion in response to three 
draft recommendations; and 3) to provide feedback on the conceptual GUIDE-IT. Sessions were audio taped and 
transcribed verbatim. Data collection and analysis were guided by content analyses. 

Results: 20 family physicians participated. They perceived guideline uptake according to facilitators and barriers 
across 6 categories of guideline implementability (format, content, language, usability, development, and the 
practice environment). Participants' feedback on 3 draft guideline recommendations were grouped according to 
guideline perception, cognition, and agreement. When asked to comment on GUIDE-IT, most respondents believed 
that the tool would be useful, but urged to involve "regular" or community family physicians in the process, and 
suggested that an online system would be the most efficient way to deliver it. 

Conclusions: Our study identified facilitators and barriers of guideline implementability from the perspective of 
community and academic family physicians that will be used to build our GUIDE-IT prototype. Our findings build 
on current knowledge by showing that family physicians perceive guideline uptake mostly according to factors that 
are in the control of guideline developers. 
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Background 

Clinical practice guidelines are considered an important 
knowledge translation tool to inform clinical practice for 
family physicians, yet their potential has not been real- 
ized due to inconsistent adoption in clinical practice 
[1-3]. Guidelines can be confusing and difficult to use 
(and even contradictory), and their implementation and 
uptake remain variable [4,5]. The research community 
classifies inquiry about poor guideline adoption into 
strategies that focus on the practice or environment (ex- 
trinsic approaches) or the guideline itself (intrinsic ap- 
proaches) to improve uptake. Extrinsic strategies are 
important since gaps in uptake and use continue to exist 
even if guidelines are well developed and implementable. 
However these strategies have had modest impact on 
quality of care with highly variable costs [6] . We believe 
that optimising the intrinsic characteristics of guidelines 
(e.g., wording and format) that are associated with uptake 
may have greater potential to improve uptake at minimal 
cost, be easier to implement, and may be broadly 
applicable. 

Implementability refers to a set of characteristics that 
"predict ease of (and obstacles to) guideline implementa- 
tion" [7], whereas Implementation refers to that part of the 
guideline lifecycle in which systems are introduced to influ- 
ence clinicians' behavior toward guideline adherence [8]. 
There has been much discussion around improving the 
rigor of guidelines [9], but few tools consider implementa- 
tion issues during guideline development with the expect- 
ation of improving guideline uptake. Existing tools include 
GLIA [7], which informs developers about potential prob- 
lems with implementation, but it is time consuming to use 
and difficult to incorporate into the development process, 
and not designed to assess the implementability of the 
whole guideline [10]; AGREE [11] can assess the methodo- 
logical quality of guidelines but provides only peripheral 
guidance on implementability; and ADAPTE [12] can be 
used to adapt existing guidelines into other settings. How- 
ever, these tools are not based on a broad literature search, 
and most target methodological and reporting concerns. 
Currently, there is no resource that takes a comprehensive 
view of all factors relevant to guideline implementability. 
Guideline developers need a usable, complementary tool to 
improve the implementability of guideline recommenda- 
tions. We developed a conceptual tool with the aid of a 
general model for planned action (i.e., the knowledge-to ac- 
tion [KTA] framework) [13]. The tool development began 
with an exhaustive review using Realist Review method- 
ology to better understand the intrinsic characteristics of 
guidelines that impact on their implementability [14]. Find- 
ings of this study are reported in another paper ([15], 
Kastner M, Hayden L, Makarski J, et al. Understanding 
the implementability of clinical practice guidelines: A 
Realist Review. Submitted), but briefly, it identified core 



implementability dimensions known to influence uptake: 
Stakeholder involvement, Evidence synthesis, Considered 
judgment. Feasibility, Message, and Format The "concep- 
tual" tool, which we call the Guideline Implementability 
Tool (GUIDE-IT), was designed according to these Realist 
Review findings in addition to consultation with experts in 
guideline development. We conceptualized GUIDE-IT as 
a 3-step process: 

1) A strategy to recruit and involve family physicians (i.e., 
the typical end-users of clinical practice guidelines) in 
the guideline development process; 

2) A process to evaluate the implementability of draft 
recommendations by family physicians recruited in 
step 1 using an objective assessment checklist 
(online or paper-based platform); and 

3) Provision of family physician assessments to 
guideline developers (who will also evaluate 
recommendations) to take into consideration when 
finalizing recommendations. 

Once we developed the conceptual GUIDE-IT tool, 
the next steps in the tool development process (accord- 
ing to our KTA framework) were to better understand 
the barriers to using the knowledge gleaned from our 
Realist Review and to transform our conceptual tool de- 
sign into a functional prototype. To do this, we wanted 
to expand our understanding of guideline implement- 
ability from the perspective of family physicians, which 
represent a large proportion of guideline end-users. As 
guideline characteristics are best assessed by end-users, 
we wanted to explore how family physicians perceive 
this concept in the context of their practice and to deter- 
mine how they respond to our conceptual GUIDE-IT 
tool. Thus, the specific objectives of this study were to 
explore 1) what guideline end-users (family physicians) 
perceive as important in guidelines, guideline develop- 
ment and uptake (i.e., what they consider facilitators and 
barriers); 2) to determine how family physicians perceive 
a set of draft guideline recommendations; and 3) to de- 
termine what components should comprise the final 
GUIDE-IT prototype. 

Methods 

We conducted a qualitative study of interviews with com- 
munity and academic family physicians. Our study was 
planned and executed in accordance with RATS guidelines 
(www.biomedcentral.com/authors/rats). We used a mixed- 
methods sampling strategy in an attempt to recruit a wider 
scope of family practice. We purposively recruited family 
physicians from the St. Michaels Hospital (SMH) family 
practice unit in Toronto, Ontario (N = 43). However, we 
needed to extend our recruitment beyond our research in- 
stitute family practice unit (which predominantly comprise 
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academic family physicians) to gain a realistic understand- 
ing of guideline implementability. To identify a broader 
spectrum of family practice perspectives (including physi- 
cians in academic and community family practice settings), 
we also randomly selected physicians from the College of 
Physicians and Surgeons of Ontario (CPSO) database in the 
greater Toronto area (N = 962). We performed this mixed 
recruitment strategy simultaneously until we reached data 
saturation. Sampling was stratified by type of physician 
(academic or community) in an attempt to maximize the 
potential for recruiting an equal representation of each. 
Based on our previous experience conducting qualitative 
interviews, we anticipated having to interview 10-15 physi- 
cians to achieve data saturation. Once providing informed 
consent, all participants were assigned a unique identifica- 
tion number to ensure the anonymity of their responses. 
The study was approved by the St. Michaels Hospital Re- 
search Ethics Board. 

Interview sessions 

Two experienced investigators conducted one-hour in- 
terviews with family physicians using a semi-structured 
interview guide (Additional file 1) with the following 3 
objectives that were planned in sequence: 

In Objective 1, we wanted to elicit feedback on partici- 
pants' perceptions of guidelines, and their views on the 
facilitators and barriers to using them. 

In Objective 2, the aim was to generate a discussion in 
response to 3 draft recommendations provided by a 
guideline development group (Additional file 2). Partici- 
pants were shown the 3 draft recommendations one at a 
time, and asked to respond to each using the following 
questions from the interview guide: 

1. What do you think the recommendation is saying? 
Do you understand it? If no, what aspects do you 
find difficult? 

2. What would you do with this recommendation in 
practice? 

3. Would you change this recommendation? Why /why 
not? How would you change it? 

In Objective 3, we wanted to elicit feedback on our 
conceptual guideline implementability tool (GUIDE-IT), 
including the generation of ideas and suggestions about 
optimal features that might enhance guideline uptake. 
The tool was developed based on the expert input of 
guideline developers and findings of our realist review 
investigating characteristics of guidelines that facilitate 
their uptake [14]. The qualitative interviews in the 
current study represent guideline end-user perspectives, 
which will contribute to other stakeholder perspectives 
in the development of the final prototype. Figure 1 shows 
the conceptual GUIDE-IT design that was presented 



to participants during the last part of the interview 
session. 

Data collection and analysis 

Sessions were audio taped and transcribed verbatim. Data 
collection and qualitative content analysis were guided by 
grounded theory methodology [16]. Four investigators inde- 
pendently developed a coding scheme by identifying, and 
labelling the primary patterns in the content using NVivo 
[8.0]. For Objectives 1-3, we used the constant compara- 
tive method to group codes into categories (where each 
category was considered as a unit of analysis). For ex- 
ample, codes for the "clarity", "specificity", "actionability" 
and "sensibility" of guidelines were grouped into a cat- 
egory called "Language". We also interrogated the inter- 
relationship of categories (axial coding). For example, we 
had group discussions to determine whether two broad 
categories, "Content" and "Language" of guidelines, should 
be combined or represented as two separate categories. 
After coding the data and reviewing the content related to 
participants' feedback on the three draft guideline re- 
commendations (Objective 2), we grouped participant 
responses according to the theory of information architec- 
ture [17,18]. This theory states that people perceive infor- 
mation before processing it and that format/layout can 
influence a person s ability to process information at both 
the perception and cognition level. We also recognized 
that beyond cognitive understanding, our informants 
spoke of a third level, which was assessment. Once they 
understood the basic message, they assessed whether it 
was logical, correlated with prior experience, and whether 
they could see themselves following the recommendation 
in practice. As such, we conducted axial coding for this 
level of analysis. To increase our validity, we also per- 
formed data triangulation, by seeking input from other re- 
searchers and experts in guideline development on our 
themes, categories and analysis. 

Results 

Of 1005 family physicians who were invited, 22 agreed 
to participate (N = 14 from the CPSO; N = 8 from SMH, 
of whom 5 were also in the CPSO database). Of these, 2 
physicians did not attend, so we conducted interviews 
with a total of 20 family physicians (10 one-on-one and 
4 group sessions). Table 1 shows the characteristics of 
participants. Most were community family physicians 
(70%) practicing for at least 16 years (60%) and younger 
than 55 years of age (65%) (Table 1). Results are de- 
scribed below according to our 3 major objectives. 

Objective 1 : Perception of the facilitators and barriers to 
guideline use 

Family physicians perceived guideline uptake according 
to facilitator and barrier factors spread across 6 categories 
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Components of GUIDE-IT 




Building a 
relationship with 
family physicians 



Evaluation of 
Recommendations 



Guide for Improving 
Recommendations 



Outlines a 
process to 
involve FPs in 
the guideline 
development 
process 



A manual for FPs to 
evaluate the 
implementability of 
specific recommendations 
(using a scoring system) 



Outlines a process for 
addressing attributes of 
the recommendation that 
can feasibly be altered 
(e.g. wording, format) 

Includes FP evaluati 



Figure 1 Conceptual design of the guideline implementability tool (GUIDE-IT) that was presented for family physicians during the 
interviews (Objective 3). 



of guideline implementability: Format, Content, Language, 
Usability, Development, and the Practice environment 
(Figure 2). 

Format (Table 2): The majority of family physicians 
identified a preference for the representation of guide- 
lines as summaries, charts or tables. Suggestions related 
to the organization of guidelines included a stepwise ap- 
proach, providing information similar to how it is laid 

Table 1 Characteristics of family physicians (N = 20) 



Characteristic N (%) 
Gender 

Women 1 1 (55) 

Men 9 (45) 
Age range (years) 

25-35 5 (25) 

36-45 5 (25) 

46-55 3 (15) 

56-65 6 (30) 

>65 1 (5) 

Type of practice 

Community 14(70) 

Academic 6 (30) 

Years in practice (years) 

<5 2(10) 

5-10 4(20) 

11-15 2(10) 

16-25 6 (30) 

>25 6 (30) 



out in lab reports, and according to what patients may 
ask. In terms of presentation, physicians want a clear 
layout that makes sense and is "pleasing to the eye". 
Some suggested that the provision of a "central resource 
(a one-stop-shop)" for guidelines would be a good deliv- 
ery system. Sections identified by participants as import- 
ant to include in guidelines were a background, purpose, 
outcomes, a clear recommendation section, and tem- 
plates to prompt for history. Guidelines described as too 
big or too long were perceived as the major barriers to 
uptake. 

Content (Table 3): Physicians identified the import- 
ance of including information about goals and targets 
(and whether these are practical and feasible), medication 
costs and choices, and to provide guidance on atypical sit- 
uations, exceptions, controversies and uncertainties. Tar- 
gets that do not fit with practice, do not apply to the 
patient population, and are difficult to achieve or con- 
stantly changing were identified as barriers. Many physi- 
cians thought it was important to include evidence and its 
quality in guidelines, but some believed that only recom- 
mendations with good quality of evidence should be in- 
cluded, while recommendations with weak or mid-level 
evidence should not. 

Language (Table 4): Many family physicians perceive 
guidelines as using language that is too dense or too de- 
tailed. They want guidelines to be clear, easy to read and 
understand; and are specific, actionable and make sense. 

Usability (Table 5): Most family physicians perceive 
guidelines as having too much information, and gener- 
ally too difficult to follow. Guidelines that do not fit with 
their practice or apply to their patient population, and 



Kastner et al. BMC Family Practice 2014, 15:1 9 
http://www.biomedcentral.eom/1 471-2296/1 5/1 9 



Page 5 of 22 



J PfO<da • StaOWtaa a$OfOaCfl . PfOvda 

r?onn*too a* do** r kjt> report*. Orgar»/e •OQje»"t»afy. 
Organs* aoaydng to sa/to-t praaantabon. Grgantta 
8C00rC«*>g to patents may as*. Ma.t> • itXidiffl 
&Z>r<c»i(t\ CXvdo /itormatcn *iccr^ r >j id w-t>vp*o*Ty, 
C*aracton*a drog» 67 VreC patent. Pn?/Oa a-** to 



abbrawtod astptanatoA of tvttanca 

• PrtM«-toto f » O* SW. Pra*ar*at©n mM« 
tan to. Piea*rg to neeye 

• Dt"vtT| f'rcN'O* a cantr* f«vxrc* (a cm-Ucp-*»O0l *cr 
guOXno*. ProvOo onina table o* contents 

• Stcbcrt incM3a • background. c*xpoae and dear 
(x/)co ■**<>*. tnctudo a dear rocor" me«"04t*:n sector lr<Ju3e 
0 index page, tnotode lenTpteiea to prompt tor haaory 



• FQf^at t>pc rf »*o «u^mary page* Daltoe agcrtr»-*or 
I ■ w KM M %H 

• P raaant rt ort Too bg or too long 

• F^atfoffn P»j**b*<ed 



CONTENT 



Goaf* and targets. VN*et*«r 
an3 Vavt>«5 Qcvsr itstcmcrt 0* *crw>**>g 
Oudance on aty;<* Mfetfl 




Doea net rcx>» *r*of c target* 



T argon trial ara ctftouR to ecf»eve or constancy cnang*<g. When 
s to order; Doea not tndude numbar needed to treat; Ignores 



DEVELOPMENT 




► Shcto gat rput from 
famty eftyaoam. w «• gudaene* « t*rpa> GP- 




HMBMort 

• Qteiy Srvxito t>a deer. Easy to reed and 



dear ovt dredon*. Snoutobe 
naAr* 

[ It to ma*e »"W) 



• Qettt Not clear, language too dense or 
delated. r>ncu*tounderstard. Open 

C Gudeve *«gue. 

r Vague about ^arttodo 
£ Not rtemg gudf*«*ei n cflw 



^ Piter*" eceutcei sponsored. 

General entrust of gudeenee 
> Oeiteaaocnent orocea* : Oevatooen do not 
under etend tit nature of ftmty pracece. Not 
\M"*t)an tor target Djdcxc Wrcen b> poc<4c net 
mvotwed prr-ery cara. Do not use a sysftar-atc 
approacft to devetoo gutootnee. Devetocers do not 
agraa on ccnesnl of gudesnes or conador 



1 Do not understand toa nature of 
tarn*/ precaoe. Daj agraa on gudc*re cornet 



f Retevert 10 prmery cara portca. Snc»w4d rnaKa a d^orc>*ca 
patdota and bt m aa n i'tg rU - Sncod ba ganaratra&ta 
• Wfidj^a fiavng t*>t -oat tp-to-dato ntonnaOon. Gv«3atn«n to«* b,«d on 



Itrtttri 

• SthLAiAf' Too nxcr> r*'or" T %jt»y> Too oon"to*caiod or of OiR to foaow. f loo 
*n>^*6c Compacaaad dncai o>a«on 

• AkCtCtb&t?' Doa* not M «rth ;<ncic* Ooaa not acpty to patent oocviUuyi 

• UBdj^fl Conttart/ Mtg^J^iMMC Not updaftad 



PRACTICE ENVIRONMENT 




I Not enovjh trr# 
to uaa gudatnai. Too -»*-y 
gudatnaa. Lac* of tupport to 
i-ptame.-C Rotou»ce i^pKatora 
Of! 



Figure 2 Categories of guideline implementabiliy as perceived by family physicians. 



are inconsistent or conflicting were also major perceived 
barriers to use. Family physicians want guidelines to be 
relevant to primary care practice, make a difference for 
patients and be meaningful. They also want guidelines 
that are quick to use and easy to remember, but allow 
for enough flexibility to apply their own judgment to 
make practice decisions. Having the most up-to-date 
guideline information or those that are built on previous 
updates was also considered a facilitator, but only if 
guidelines are not constantly changing. 

Development (Table 6): Our participants believed that 
guidelines should be developed by a trusted and credible 
source with input from family physicians. Some believed 
that the specialists who develop guidelines do not under- 
stand the nature of family practice and as such are not 
the appropriate persons to write them. A few family phy- 
sicians expressed a lack of trust in guidelines either be- 
cause they questioned the "solidity of recommendations" 
or because they were industry sponsored. 

Practice environment (Table 7): Participants wanted 
guidelines to be accessible and available at the point of 



care, but many have difficulty finding them or simply do 
not know that they are available. Almost half of partici- 
pants indicated that lack of time was a major barrier to 
implementation of guidelines. Other perceived barriers 
were too many guidelines and a lack of support to im- 
plement them, and that available resources are not taken 
into consideration when designing guidelines to be able 
to appropriately implement them. 

Objective 2: Participants' suggestions for revising draft 
recommendations 

Using the theory of information architecture [17,18], 
feedback from family physicians on the 3 draft recom- 
mendations were grouped into 3 categories: 1) Percep- 
tion of the recommendation (i.e., whether physicians 
believed that they could or wanted to engage with the 
recommendation in terms of their ability to see, hear, or 
become aware of something through these senses). 2) 
Cognition of the recommendation (i.e., whether physi- 
cians understood the recommendation in terms of the 
mental action or process of acquiring knowledge and 



Table 2 Facilitators and barriers of guideline implementability as perceived by Family Physicians: FORMAT 



Facilitators (Number of respondents) 


Utterance example 


Barriers (Number Utterance example 
of respondents) 


Format type 


Summaries (N = 8) 


• It would be helpful to have a quick summary because the guideline 
will be read at one point but not while the patient is there. {1-8} 


If no summary • If there was no summary pages provided {FG4-P2} 
pages (N = 1) 


Charts or tables (N = 5) 


• Tabular form would be the most useful because it is very clear. {1-3} 






• 1 appreciate having tables, charts, flow charts - 1 usually refer to these {1-4} 




Algorithms or flowcharts (N = 3) 


• If 1 can't discern where the guideline's direction is then that's how you know 
that sometimes algorithms are really much more helpful because we only 
have maybe 10, 15 minutes per patient. {FG1-P2} 


Algorithms/ • Flowcharts are too complex and confusing {FG4-P2} 
Flowcharts (N = 3) 




• Clear decision trees in terms of how to go through management 
decision making processes. {1-1} 


• / am not crazy about algorithms - it takes a while to 
get through it; Even if the guideline is no longer than 
15 pages, if there are a lot of algorithms and a lot of 
text, it sort of goes out of my mind. - 1 don't like them 
and find the print too small {1-3} 


Flow sheets (N = 3) 


• A great tool is flow sheets that can be incorporated into practice and be 
used to track patients' progress according to guideline recommendations, 
it's easy to use and follow {1-1} 




Books or booklets (N = 2) 


• The guidelines 1 use more frequently are in a booklet form with an index 
so you can look up what you want {1-3} 


Booklets (N = 1 ) • / get turned off very quickly if 1 get booklets {FGI-P2}' 




• If you provide booklets, have it colour coordinated {FG2-P2} 




Laminated cards (N = 1) 


• Guidelines boiled down to a one page laminated card that is easy to use 
(e.g., diabetes flow sheet published by the ministry) {1-1} 




Checkboxes (N = 1) 


• Checkboxes are wonderful - having clear check boxes or something to 
say that the test was completed and indicative of the diagnosis; have some 
of the checklists compatible to billing purposes {1-2} 




Desk calendar (N = 1) 


• A desk calendar format (e.g., diabetes guidelines) is user-friendly readable 
but evidence-based and accessible as it can go on a desk or shelf as a 
visual reminder of the guideline. {FG1-P3} 




Organization (N = 16) 


Provide a stepwise approach (N = 2) 


• Guidelines are useful if they provide a staged, progressive approach so 
if you are stuck you can keep going through stages {FG3-P1} 




Provide information as done in 
lab reports (N = 2) 


• / wouldn't be able to recall the numbers and ranges from cholesterol 
and diabetes guideline, but they are in every lab report so 1 can't help 
but use them and discuss with patients - why can't guidelines do 
the same? {FG2-P2} 




Organize sequentially (N = 1) 


• Guideline recommendations should be sequential - it should say why we're 
choosing this particular option (we can go this way or that way) {1-7} 




Organize according to patient 
presentation (N = 1) 


• Having materials well organized into blocks of presentation: presenting 
complaint, family history, reason for problem {1-2} 





Table 2 Facilitators and barriers of guideline implementability as perceived by Family Physicians: FORMAT (Continued) 



Organize according to what patients • Methods of presentation that geared toward questions that patients 
may ask (N = 1 ) are likely to ask {I- 1 } 



Have a structured approach (N = 1) 


• Having a structured approach so that no detail is forgotten. {1-2} 


- 


- 


Divide information according 
to sub-specialty (N = 1) 


• 1 can't keep track of all the names of the studies - ones from 
cardiovascular, osteoporosis, diabetes. So, they could be divided 
up according to sub-specialty {FG2-P1} 






Characterize drugs by type 
of patient (N = 1) 


• / like the ones that integrate into the way do things anyway 
(which drug to choose first, like in hypertension). It lays it out 
clearly and characterize the type of patient that would do better 
with this vs that drug {1-8} 






Provide e-link to more evidence 
(N = 1) 


• Provide an e-link to the evidence so that doc can verify appropriateness 
of recommendation for their patient; include outcomes with links to 
evidence supporting recommendations; for reassurance of 
recommendation and for use to educate patients {FG1-P2} 






Provide suggestions with links 
(N = 1) 


• Provide suggestions with links so it can be drilled down {FG1-P1} 







Provide abbreviated explanation • Could provide an addendum of a very simplified version of the more popular - 

of evidence (N = 1) studies - an abbreviated explanation of the study and its findings {FG2-P1} 



Presentation (N = 1 3) 



Clear layout (N = 2) 


• Clearly and accessibly laid out for management {1-1} 






Short (N = 2) 


Short guidelines (3 pages) are easy to read, understand and implement 
(the way old diabetes guidelines used to be) {1-6} 


Too big/too long 
(N = 7) 


• It's frustrating when they are super big {FG4-P1} 

• If it has 4 or more pages, 1 don't even look 
atit{FG2-P2} 


Pleasing to the eye (N = 1) 


• Methods of presentation that are pleasing to the eye {1-1} 






Presentation makes sense (N = 1) 


• Methods of presentation that make sense {1-1} 







Delivery (N = 4) 



Provide a central resource • The ideal guideline would be a one-stop-shop like "Up-to-date" which 

(a one-stop-shop) for / use because I know I just go there and get the answer.; I would love to 

guidelines (N = 3) have a central resource which contains all of the most trusted and 

strongest guidelines, where I can go, search the information I want 

and have the answer pop up {1-1} 

Provide online table of contents • Include an online table of contents where you can quickly get to 
(N = 1) the info and click the section you are looking for {1-5} 

Sections (N = 6) 

Include a background (N = 1) • Provide background {1-1} 

Include purpose of the guideline • Simple articulation of the purpose of the guideline is extremely 

(N = 1) important {1-2} 



Include clear outcomes (N = 1) • Include clear outcomes {FG1-P2} 



Table 2 Facilitators and barriers of guideline implementability as perceived by Family Physicians: FORMAT (Continued) 



Provide a clear recommendation 
section (N = 1) 



Provide a clear index page (N = 1) 



• They have a very clear recommendation section at the end of any article 
that you can always flip to and then go back, they will also have a lot 
of the supporting evidence there so it kind of provides a nice 

balance in that way {1-1} 

• Provide a clear index page {1-9} 



Include templates to prompt 
for history (N = 1) 



Platform (N = 4) 



• Providing a template of information to prompt for family history or 
date of last check up or other details and comprehensive review of the 
problem would facilitate the use of guidelines and make more time 
for family doc {1-2} 
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Electronic (N = 3) 



Paper-based (N = 1) 



• Having it online at some free location where you don't have to 
login would be good {1-5} 



• A useful guideline is one that is available at the POC - so that 
comes in either a convenient hard copy document (e.g., CHEP, 
which has the summary packet on hypertension guidelines) that 
you can search very quickly as opposed to the diabetes guidelines 
which are several hundred pages {1-5} 



Paper-based (N = 1) • / don't want paper-based {FG2-P2} 



Table 3 Facilitators and barriers of guideline implementability as perceived by Family Physicians: CONTENT 



Facilitators (Number of respondents) 


Utterance example 


Barriers (Number 
of respondents) 


Utterance example 


Specific content to include (N = 17) 


Goals and targets (N = 2) 


• Provide easily understandable goals and targets that can 
be applied in practice. {1-1} 


Does not include 
specific targets (N = 1 ) 


• Some guidelines like Diabetes are hard to follow because they 
include sections at the end with special groups. It's important 




• Like to see a clear statement of the targets aimed for {FG4-P2} 




that these subgroups [aboriginal] are mentioned because they 
are higher risk group and you have to keep a closer eye on them 
for complications but the recommendations become more defuse 
or nebulous or vague that obviously come out of some evidence 
base but don't provide specific targets to follow and are not 
useful for every day frontline practice situations {1-1} 


Whether targets are practical 
and feasible (N = 1) 


• Whether guidelines are practical, feasible are the most 
important in terms of the numbers that should be targeted 
(for example in hypertension guidelines) in terms of the first 


Targets that are 
difficult to achieve 
(N = 2) 


• In hypertension guidelines it's very hard to achieve the targets 
that they recommend {1-4} 




second, third-line medications {1-4} 


Targets constantly 
changing (N = 1) 


• Sometimes targets [such as in Gholesterol guidelines] are 
unattainable because they are always changing and difficult 
to achieve in the real world {FG3-P2} 


Clear statement of screening, 
diagnosis and treatment (N = 1) 


• Like to see a clear statement of the screening and diagnosis 
or management, and the targets aimed for {FG4-P2} 


Which tests to 
order (N = 1) 


• There is a point of frustration for me sometimes, like what 
tests to order [Right] you know, like for TSH {FG4-P1} 


Guidance on atypical situations 
(N = 1) 


• Guidelines should provide guidance on what is atypical - 
to know the procedure or how to investigate the red flags 
in a timely manner; to know what to do and is appropriate 
for things that are not as common like retinal detachment - 
to know the red flags and what to look for and what procedure 
to investigate in a timely manner {1-8} 


Does not include 
number needed 
to treat (N = 1) 


• The thing 1 always look at is, is the sort of how many 
people needed to treat you know, so if 1 have to put 1000 of 
my patients on beta blockers to save one Ml you know, that's 
not going to be implemented or the guideline 1 am going to 
get very excited about. So the number needed to treat, are 
the things 1 think are not available in guidelines and should 



be, because that's the evidence. {FG1-P3} 



Guidance on uncertainties (N = 1) 


• It's good that Hypertension guidelines address uncertainties 
so you know what to do for high risk, intermediate and low 
risk patients (e.g., controversies around the secondary 
markers besides LDL and HDL). {1-6} 






Guidance on exceptions (N = 1) 


• Include exceptions and how to deal with them {1-1} 






Controversies (N = 1 ) 


• In some cases, you would want more information. They 
have to show the controversy and they've got to show how 
they've looked at both sides {1-6} 


Ignores controversy 
(N = 1) 


• It isn't helpful if a guideline doesn't address areas of 
controversy or ignores it {1-6} 


How long things should take 
(N = 1) 


• In some investigations where timeline is an issue, it would 
be helpful if guidelines included information on how long it 
should take or don't leave it more than this long or investigate 
this and then this or do all {1-8} 






When to refer (N = 1 ) 


• It would be good to know when to refer. 1 sometimes refer and 
then the specialists comes back to ask why 1 referred {FG2-P2} 







Table 3 Facilitators and barriers of guideline implementability as perceived by Family Physicians: CONTENT (Continued) 



Information about evidence (N = 16) 



Include evidence (N = 5) 



• Provide evidence and its quality {1-1} 



Provide the evidence behind recommendations {FG1-P2} 



Including weak • Grade D evidence should not be considered or included 

evidence (N = 3) in guidelines {FG1-P3} 



Include information on quality 
of evidence (N = 6) 



• Guidelines should provide the strength and quality of evidence 
with the statement {FG1-P1} 

• If it's Grade A evidence, then I feel much more comfortable 
using that{FG1-P2} 



Recommendations 
supported by mid-level 
evidence (N = 1) 



Provide flow sheets (N = 1 ) 



• For more complex evidence, provide flow sheets {FG1-P1} 



» The most difficult is to follow a guideline with mid-level type of 
evidence where I'm not quite sure which direction to follow - 
If its B, C or D, it is against consensus which is what makes it 
much more difficult - I question using that particular guideline 
and makes it difficult for me to implement that into my 
practice {FG1-P2} 
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Information about medications (N = 15) 



Include medication costs (N = 6) 



• Specialists will say that patients with hypertension are not being 
treated adequately and family physicians are not doing a good 
job but sometimes it's difficult to follow guidelines because of 
cost of medication and so we can't do exactly what the 
guidelines say {FG3-P3} 



No information on • Many times, I get a report back that is totally useless 

medications (N = 1) because it's not telling me whether or not the drug my 

patient is taking is effective or not, that is, it's not clear 
whether it's simply not reported in the guideline because 
the guideline committee decided to leave out this 
information {1-10} 



Include medication choices 
(N = 5) 



• Guidelines should point in the right direction if the first or 
second-line treatments aren't going to work for whatever 
reason. I like how the hypertension guideline help you choose 
the right drug - the ones that integrate into the way do things 
anyway (which drug to choose first). It lays it out clearly and 
characterize the type of patient that would do better with this 
drug vs another - particularly in my practice where I have a 
multicultural practice because certain populations are different 
and you want to know that {1-8} 



Does not address the 
pros and cons of 
medications (N = 1) 



Include brand names (N = 1) 



• Guidelines could provide the brand names in brackets for 
the common medications. {FG2-P1} 



• Guidelines don't strongly address the pros and cons of 
medications (e.g., bisphosphonates for osteoporosis) {1-6} 



Table 4 Facilitators and barriers of guideline implementability as perceived by Family Physicians: LANGUAGE 



Facilitators (Number of respondents) Utterance example Barriers (Number of respondents) Utterance example 



Clarity (N = 18) 


Clear (N = 6) 


• Guidelines need to be clear {1-6} 


Language too dense or detailed 
(N = 8) 


• When it comes to wording of recommendations, if there is 
too much information in a single recommendation, the 
reader gets lost in it. {1-5} 


Easy to read and understand 
(N = 2) 


• Guidelines need to be easy to read and understand {1-6} 


Difficult to understand (N = 1) 


• If recommendation is hard to understand, 1 just 
glaze over it {1-2} 


Specificity (N = 11) 


Specific (N = 7) 


• Guidelines need to be as specific as possible to the 
question {1-2} 


Guideline vague (N = 4) 


• If the guideline is vague, if for example 2 medications fits 
all approaches then 1 find that not very useful {1-3} 


Actionability (N = 7) 


Doable and directive (N = 3) 


• It should guide the questions that you are asking and get 
you to the decision making point in the guideline; Guidelines 
should direct me through the end stages of management 
and diagnostic processes so it gets to the bottom line 
recommendations {1-1} 


Vague about what to do (N = 2) 


• Often the actual recommendation does not answer the 
question - it may give you a direction but you may 
need to dig deeper to find out how to actually carry 
out the recommendation {1-5} 


Having clear cut instructions 
(N = 1) 


• If you pushed for time or you have extenuating 
circumstances or a, a visit includes parents or other 
informants that may have different ideas you 
eliminate the distractibility of not completing the 
information you do need by having clear cut 
instructions as to what should be included. {1-2} 






Should be comprehensive 
(N = 1) 


• Something that's comprehensive so that if you're pushed 
for time or you have extenuating circumstances or a visit 
includes parents or other informants that may have 
different ideas you eliminate the distractibility and have 
clear cut instructions as to what should be included {1-2}. 






Sensibility (N = 3) 


It has to make sense (N = 2) 


• It has to make sense, whatever the new thing is. So 
often the guideline comes out and 1 will often sit back 
and say 1 don't think this really makes sense, and it 
doesn't resonate with me, like HRT. {1-6} 

• Guidelines need to be intuitive and logical {FG4-P2}. 


Not having guidelines in other 
languages (N = 1) 


• One barrier may be language, not having things available 
in the language of the physician or patient. Some of the 
materials need to be filled in by the patients as well and 
if they don't understand the date of last pap smear was, 
then the information is going to have limited use {1-2} 



Table 5 Facilitators and barriers of guideline implementability as perceived by Family Physicians: USABILIY 



Facilitators 

(Number of respondents) 


Utterance example 


Barriers (Number of respondents) 


Utterance example 


Simplicity (N = 14) 


Simple (N = 4) 


• Keep it simple and straightforward {FG1-P3} 


Too much information 


• It's not helpful if the guideline requires some reading, and 




• Guidelines have to be simple and straightforward, if it's 
complicated I'm not going to remember it anyway and 
won't look at it {FG2-P2} 


(N = 3) 


people have varying levels of patience and time to read 
around the recommendations to find out how they are 
supposed to implement the recommendation {1-5} 




Too complicated or difficult 
to follow (N = 4) 


• Some guidelines are very complex (i.e., the ones with 
30 recommendations) and written above the practice level, 
so will not go back to it because its overwhelming and a 
bombardment of information - no time to fit into brain. 
There should be 5 of the most important things that 
should be given to family physicians (by specialists) 
to remember {1-1} 






If too simplistic (N = 2) 


• Guidelines are meant to simplify but sometimes they 
become too simplistic {FG3-P3} 






Complicated clinical 
questions (N = 1) 


• We struggle with the complex management questions 
(e.g., if there is 4 second degree relatives but no first degree 
relative when considering mammography at age 
40 instead of age 50) {1-10} 


Applicability (N = 11) 


Relevant to primary care 
practice (N = 1 ) 


• Answers questions that are relevant to primary care and thus 
clinically useful {1-10} 


Does not fit with practice 
(N = 5) 


• What they tell you to do and what you actually do in 
your practice never seem to match up {1-8} 


Should make a difference 
for patients (N = 1) 


• So, / think one of the things that 1 would want to see 
is if it makes a difference to my patient you know, just 
having a lower level or having everybody with a 
hemoglobin A1C of whatever, it doesn't always translate 
into healthier patients {FG1-P3} 


Does not apply to patient 
population (N = 3) 


• Applicability to primary care population is a barrier; 1 think 
it's also that specialists see a particular population and they 
are coming from a particular viewpoint. But then, as a 
primary care physician, your population is going to be a 
little bit different, so 1 think that's where the challenge lies {1-9} 


Should be meaningful 

(N = 1) 


• The number needed to treat has to be meaningful to 
make it implementable (putting 1000 people on beta 
blockers to save 1 Ml is not implementable) {FG1-P3} 






Updating (N = 8) 


Having the most up-to-date 
information (N = 1) 


• One quality that would influence my decision making is 
guidelines that are current and have the most 
up-to-date information {1-2} 


Constantly changing 
guidelines (N =4) 


• Changing/update of evidence forces changes to routine practice 
that is difficult to explain to patients {FG2-P1} 


Guidelines that build on 
previous updates (N = 1) 


• Guidelines that are helpful are those that build on previous 
updates (e.g., blood pressure and hypertension guidelines), 
the ones that build on what you already know {1-9} 


Guidelines that are 
not updated (N = 2) 


• There are also recommendations which don't seem to fit with 
what 1 know of the latest evidence, where 1 start wondering, 
okay just how up to date is this thing, 1 mean that's another 
barrier to it. {1-1} 


Ease of use (N = 6) 


Quick to use (N = 4) 


• Guidelines should be quick to use because family 
physicians' approach to seeing patients is different than 
specialists - less time to reflect on how to manage {1-3} 







Table 5 Facilitators and barriers of guideline implementability as perceived by Family Physicians: USABILIY (Continued) 

Easy to remember (N = 2) • Something that sticks in my mind and can be used on a - 

day-to-day basis {1-1} 

Consistency (N = 5) 

Consistent (N = 1) • / mean we forget about the rest of the world {Laughter} I Inconsistent or conflicting • Recommendations that are not firm and sort of all over the 

mean you have guidelines from every country but at least in (N = 4) place (e.g., one guideline states to exercise 30 minutes/day 

Canada they're getting some consistency in terms of you while another states 5 minutes/day); this was a big issue 

know, the big diseases which is nice {FG4-P2} when hypertension and cholesterol guidelines did not sync 

with diabetes. {1-1} 

Flexibility (N = 3) 

Flexible (N = 3) • Guidelines have to be flexible; Sometimes there is no 

flexibility when they say you can do this and then next 
step is first line, second like - this should be fairly 
straightforward but in reality it's not always easy to 
do that{FG1-P3} 



• Guidelines should allow you to be creative and let you 
think outside of the box in case something doesn't fit 
in smoothly {1-2} 



Table 6 Facilitators and barriers of guideline implementability as perceived by Family Physicians: DEVELOPMENT 



Top facilitators (Number of utterances) Utterance example 
Trustworthinesss (N = 13) 



Top barriers (Number of utterances) Utterance example 



Guidelines from a trusted 
and credible source (N = 5) 



• / need to see that the guideline has been endorsed by Pharmaceutical sponsored (N = 4) • / will flip very quickly over to who sponsored it, and if there 



credible sources [FG1-P1 I trust guidelines developed by a 
central committee of experts that are recognized from 
across the country such as diabetes or hypertension - 
when I trust a guideline, it is easy to understand and 
commit to memory and refer back to it over and 
over again {1-1} 



is a pharmaceutical company on it, then I tend to take it 
with a grain of salt. So, those are also called guidelines 
and sometimes it's hard to distinguish {1-6} 



Include who developed the 
guideline and how (N = 1) 



• Its important to know who developed the guideline 
and how they developed it. {1-6} 



General distrust of guidelines 

(N = 3) 



• Just because something is a guideline, I don't 
necessarily trust that it is not conflicted, so that's 
a concern for me {1-1} 



Development process (N = 12) 



Developers should get input 
from family physicians (N = 1) 



• Specialists writing the guidelines should probably get 
input from family physicians - for hypertension, it says 
use this medication because it's wonderful, but when 
you are facing the patient, they tell you that they 
can't afford it {FG4-P1} 



Developers do not understand 
the nature of family practice 
(N = 2) 



• They [guideline developers] should realize that an 
appointment is 10 minutes and you need to deal with 
an issue, prescribe the medication, and talk about the risks 
and side effects in that 10-minutes, and if you can't deal 
with all the issues in 10 minutes then the guideline is too 
cumbersome {FG4-P2} 



Developers should write 
guidelines in simple "GP" 
language (N = 1) 



• Put guidelines in simple "GP" language {FG2-P1} 



Not written for target audience 
(N = 3) 



• So I don't think they are clear as to exactly who they were 
writing for: for doctors in general or just for family 
doctors {FG1 -PI} 



Written by people not involved 
in primary care (N = 1) 



• It's written by people who are likely not involved in 
primary care. We need something that you can very 
quickly skim through, and they are not always 
created that way {FG1-P1} 



Developers should perform a 
good literature review (N = 1) 



' You want to feel that guideline developers have 
looked at all the information and did a good 
literature review. {1-6} 



Developers do not use a 
systematic approach to develop 
guidelines (N = 1) 



• / don't think guidelines are developed using a systematic 
approach, and it's a slow process {FG4-P1} 



Developers do not agree on 
content of guidelines (N = 1) 

Developers do not consider 
practicality and accessibility 
(N = 1) 



• So, among specialists, I don't think they agree on the 
guidelines anyway. Some specialists have different 
opinions than those in guidelines {FG2-P2} 

• Guideline developers focus is the content of the 
recommendations not the accessibility or practicality 
of it, so they see it from a different perspective. {FG4-P2} 



Table 7 Facilitators and barriers of guideline implementability as perceived by Family Physicians: PRACTICE ENVIRONMENT 



Top facilitators (Number of utterances) Utterance example 



Top barriers (Number of utterances) Utterance example 



Accessibility (N = 12) 



Should be accessible (N = 3) 



• Accessibility of the information is a factor that will 
impact on implementability {1-9} 

• It has to be something that can be handy and 
accessible {1-5} 



Not accessible (N = 6) 



Available at the point of care 
(POC) (N = 2) 



• A useful guideline is one that is available at the POC - 
so that comes in either a convenient hard copy 
document that you can search very quickly as 
opposed to the diabetes guidelines which are 
several hundred pages. Osteoporosis has a little 
one-pager that was sent out with the journal {1-5} 



Timely access (N = 1) 



• It should be timely in terms of my time and the time it 
takes to read it, and to have it so I can use it {1-10} 



• Guidelines are not accessible {FG1-P3} 

• If I have to look for it, it will not happen as easily {FG2-P2} 

• One thing I find difficult about using different guidelines is 
just finding them when I need them {Laughter} {1-8} 

• Guideline developers focus is the content of the 
recommendations not the accessibility or practicality 
of it, so they see it from a different perspective {FG4-P2} 

• One of the barriers is not realizing that the guidelines 
are available {1-2} 

• One of the big problems in terms of accessibility with 
guidelines, you've to find them, so are they there when 
you need them {1-1} 



Implementation (N = 10) 



Not enough time to 
use guidelines (N = 8) 



Too many guidelines 
(N=4) 



Lack of support to 
implement (N = 1) 



Resource implications 
of following guidelines 
(N = 1) 



• / don't have time to read the whole guideline {1-4} 

• / don't have time, I'm, I am not seeing just hypertension 
patients, like the cardiologist so I don't have all the time 
to deal with all the details and all the facts, so guidelines 
should be thinking about our time {FG2-P2} 

• There are so many of them [guidelines] and it's difficult 
to know which to follow because the easy ones you 
remember (e.g., Diabetes) because you know the 
ideal target;with hypertension, it tells you, this is 

my first choice, what should I do step by step, 
but I don't think I will do that. {FG2-P2} 

• There are too many guidelines to keep abreast {1-2} 



» We don't have you know, enough support to help 
you know, explain all the things that we are doing 
so that the outcome is better {1-9} 



• One barrier is resources - I don't think the evidence 
is there or the system is ready for every single male 
patient over the age of 50 year to get screened for 
prostate cancer (i.e., PSA test). I don't think Urologists 
would know how much volume they would get if every 
single patient was screened for PSA. {1-5} 
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understanding through thoughts, experience, and the 
senses); and 3) Agreement on recommendations (i.e., 
whether participants agreed with the recommendation 
or the concept of guidelines in general). 

Table 8 shows the feedback on the three draft recom- 
mendations provided by physicians across these 3 categor- 
ies (see Additional file 2 for original recommendations). 
Physicians perceived the recommendations to be disorga- 
nized (N = 8), wordy (N = 6) and too long (N = 4). They 
suggested shortening, and visually separating or organiz- 
ing the information using lists or point form in tables or a 
flowchart. Physicians' understanding of the recommenda- 
tions was hampered by their lack of understanding of the 
evidence grading system used to support the recommen- 
dations (e.g., the meaning of "Grade A, level 1") (N = 6), 
its complexity (N = 4) and lack of specific information to 
accurately interpret statements (N = 4). To overcome 
these problems, physicians suggested defining vague 
terms, acronyms and phrases and using words familiar to 
physicians; using footnotes to define and specify the evi- 
dence grading system supporting recommendations; and 
creating organized lists, groups, tables and flowcharts to 
minimize complexity of the information. 

There was low agreement with the 3 draft recommen- 
dation statements for several reasons. First, physicians 
thought that the statements were impractical (N = 11) as 
they did not consider the necessary resources to perform 
the recommendations or were incongruent with provider 
and patient values. To address this problem, physicians 
suggested individualizing recommendations by consider- 
ing costs, human resources and provider and patient 
values in their recommendations. Second, physicians 
thought that the recommendations lacked clinical sense 
(N = 6) as there was no clear direction of action or infor- 
mation was missing. Suggestions were to use clear and 
actionable language such as active voice, the provision of 
more background information, to include clear targets 
for patient outcomes, and to include information on the 
benefits and harms of treatments. Another factor affect- 
ing participants' agreement with statements was the ap- 
parent poor evidence supporting them. In such cases, 
physicians suggested omitting detailed and specific guid- 
ance in order to simplify recommendations. Lastly, par- 
ticipants perceived the recommendations to be too 
aggressive to apply (N = 4), that is the specified clinical 
targets were either not achievable or suggested interven- 
tions were more intense than what they thought their 
patients would prefer (e.g., being on 3 medications in- 
stead of 1 or monitoring twice a day instead of once a 
day). To address these issues, physicians suggested pro- 
viding more background information, acknowledging 
that the statement represents a change from current 
practice, and to underscore the rationale for such 
changes. Figures 3A-C show each of the three original 



draft recommendations and the revised statements ac- 
cording to family physicians suggestions. 

Objective 3: Participants' feedback on the conceptual 
GUIDE-IT 

Three themes emerged from our discussion with partici- 
pants about the conceptual guideline implememtability 
tool (GUIDE-IT): 

Theme 1: General feedback on GUIDE-IT: Most par- 
ticipants believed that the tool would be useful, and that 
involving family physicians in the guideline development 
process would be important and appropriate (N = 12), 
but believed that these physicians should represent 
"regular" or community family physicians: 

It should go out to family physicians, but 'regular' 
family physicians should be looking at it and you know 
discussing whether it is useable from their perspective 
{FG3-P3; FG = Focus Group; P = Participant}. 

Theme 2: Strategies to involve family physicians in the 
guideline development process: Participants suggested 
several strategies to encourage the involvement of family 
physicians in the guideline development process. First, 
they suggested forming a primary care practitioner 
working group, which should also include patients and 
those involved in team-based care. 

Second, participants believed that their involvement in 
the process would present a unique opportunity to make 
developers better understand what they need in the 
frontlines so that guidelines can become more clear, use- 
ful and less burdensome. Specifically, they suggested 
having a checklist to assess recommendations based on 
simplicity and clarity, to indicate the 5 most important 
points to consider, and to be able to look at how guide- 
lines are organized: 

".../or them it makes sense but for us it may not If you 
were around the table, you could clarify to them what 
would make sense for you in your practice, and it will 
be faster and make it more efficient. " {FG4-P1} 

However, participants also thought that there could be 
some downsides to family physician involvement includ- 
ing delays in getting guidelines out and potential barriers 
to sustainability given the potential costs and resources 
it may require to continue this process: 

People get anxious about not having the latest information 
or how long it takes to get the guideline out (whether its 
up to date by the time it gets out), and if this tool will 
delay it significantly I think there will be resentment from 
the committee, even the actual guideline developers 
themselves and from the end users. {I-I; I = Interview} 



Table 8 Family physicians' perceptions, cognition, and agreement with 3 draft recommendations, and their suggestions for overcoming identified problems 



Category 


Identified problem (Number of respondents) 


Suggestions to improve (Number of respondents) 


How to do it 


Perception 


Disorganized (N = 8) 


Visually separate (N = 5), organize (N = 4) 


Create organized lists, groups, tables; Create flowchart 




Wordy (N = 6) 


Simplify, shorten (N = 2), visually separate (N = 5) 


Point form, tables 




Long (N=4) 


Simplify, shorten (N = 2); visually separate (N = 5) 


Lists, tables 


Cognition 


Do not understand grading of evidence quality (N =6) 


Define grading system of evidence quality (N = 6) 


Use footnotes to explain grading of evidence; Hyperlink to more 
information about how grading is defined 




Confusing/complex (N =4) 


Visually separate (N = 5); organize (N =4); match the 
system with the real world (N = 3) 


Create organized lists, groups, tables; create flowchart; use terms 
familiar to physicians 




Lacking information (N = 4) 


Define terms and phrases (N =4) 


Define acronyms; define vague terms 


Agreement 


Not practical (lacking necessary resources, incongruent 
with provider and patient values) (N = 1 1) 


Individualize (N = 4) 


When formulating recommendations, consider costs, human 
resources, & provider & patient values 




Poor evidence (N = 6) 


If the evidence is poor, simplify the recommendation 
(N = 4) 


Do not give detailed and specific recommendations when there 
is weak evidence to support it 




Does not make clinical sense (no clear direction, 
missing information) (N = 6) 


Clear and actionable language; provide more 
background information (N=4) 


Use active voice; include clear targets; include information about 
benefits and harms 




Too aggressive (i.e., targets, intervention, monitoring) 
(N = 4) 


Provide background information for the 
recommendation (N = 8) 


Acknowledge that it is a change from current practice and 
underscore the rationale 
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Original Recommendation 



In persons at low risk of CVD 
events, the serum LDL should 
be lowered by at least 50% from 
baseline. 



Revised Recommendation 

Actionability: Does this mean all 
patients who fall in this category or a 
specific subgroup of patients? 



(Wording) 



9t Iqw risk pf cW events 
pist specific subgroup], lovs^rthe 



Active voice 

(Wording) 



Pist specific subgroup], I 
serum LDL by 50% or more from 
baseline [which is...]. | 



Vagueness 
What is the baseline 
referring to? (Wording) 



Undorspecification: 
To improve specificity, indicate 
"50% or more" (Wording) 



B 



Revised Recommendation 



Original Recommendation 



The use of home BP monitoring 
on a regular basis should be 
considered for patients with 
hypertension, particularly those 
with: i) diabetes mellitus (Grade 
D); ii) chronic kidney disease 
(Grade C); iii) suboptimal BP 
control; iv) suspected non- 
adherence (Grade D); v) 
demonstrated white coat effect 
(Grade C); and vi) BP controlled 
in the office but not at home 
(masked hypertension) (Grade ) 



Active voice Specific target 

(Wording) (Wording; Feasibility) 

[Consider] [weekly] home BP monitoring 
for any patient with hypertension, with 
special emphasis on those with: 



i) Chronic Kidney disease (Grade C) 

ii) Demonstrated white coat effect (Grade C) 

iii) Diabetes Mellitus (Grade D) 

iv) Non-compliant (Grade D) 

v) Suboptimal BP control (Grade ?) 

Grade C: some evidence of benel 
Grade D: expert consensus 




Visual separation 
improves 
perception, 
cognition, and 
> memory (Format) 
Ordered 
according to 
evidence grading 
(Format) 



Define evidence 
grading (Rigor of 
development) 



Include strength 
of evidence (Rigor 
of development) 



Original Recommendation 



For with debates end normal u*r\ary 



frMM. wtHBP* 130-aO mm Hg. despite 
Mostyto totervemcris: Any oi the toiowlng 
medcatons (ksted ft stohflboftrn' ordor) s 



ACE ir*fc»OT art ARBs given the* 



Consensus, for the special consderaton to 
AC€ mtWMort and ARB>] ACE mhiMor 
(Grade A. Level 1 A (19)|. ARB [Grade A. 
Level 1A (20); Grado B. Lovol 2. tor non-toft 
ventricular riypertrophy (20)J. OMP CCS 
[Grade B. Leva) 2 (22fc TNeiide-*ke dwreOc 
[Grade A. Lava! 1 A (22JJ; if the above drugs 
pootralndicaled or cannot be tolerated, a 
cordceotoebve beta blocker [Grade B. Level 

2 (21 )] or non-OHP CCB [Grade B. Leva) 2 
(23)] can be subetoxed. Addtionai 

lyportonsrvo drugs should be used if 
target BP levels ate not achieved v/th 
standard-dcee rflonce>erepv [Grade C. Leva) 

3 (12.22)]; Add-on drugs should be choeen 
from trio flrst-lne choices Itstad above [Grado 
□.Consensus) 



Revised Recommendation 



according to evidence grading 

CfvMwnee; 



For person* with diabetes and norma) uwwy albumin excreton and 
without chrooc kidney disease, with BP * 1»W mmHg. 
Hash/to IrtarvarOooe: Any of the tosowing medkaaona (» 
order of evidence grading) is recommended, with speoal 
consideration to ACE rvvbrtors and ARBa given their additional renal 
benefits [Grade 0] 

a frst lna ACE inhibitor [Grade A-1 A]' >. ARB (Grade A-1AJ M 
Tho/tdelke durobc [Grade A 1Ap. ARB [Grade 8-2 tor non-toft 
ventricular hypertrophy^-. Of* 9 CCB (Grade B-2p; 
o ft»rywwuifM> w the above drugs are ccncrandcetod or cannot be 
i canosetoctrre beta blocker [Grade B- 





Use Active voice 

(Wording) 



complexity of 
presentation by formatting 
references as superscripts 

(Formal) 



Visual separation such as 
using bullets and 
underlining Improves 
perception, cognition, 
and memory ("former; 
Ordering according to 
evidence grading 



[ftomtLogfctJ 



Figure 3 (See legend on next page.) 
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(See figure on previous page.) 

Figure 3 Three draft recommendations presented to family physicians (Objective 2), depicting their perceptions of problems identified 
in the original recommendation and their suggestions for revising. A. Draft recommendation 1 presented to family physicians (Objective 2), 
depicting their perceptions of problems identified in original recommendation and their suggestions for revising. B. Draft recommendation 2 
presented to family physicians (Objective 2), depicting their perceptions of problems identified in original recommendation and their suggestions 
for revising. C. Draft recommendation 3 presented to family physicians (Objective 2), depicting their perceptions of problems identified in original 
recommendation and their suggestions for revising 



Some participants thought that family physicians 
might be "drawn in" to participate purely out of interest, 
but most believed that some compensation would be 
needed for their time either in the form of a monetary 
incentive or through the provision of continuing medical 
education credits: 

Another way could be is to use conferences, focus a 
3-hour workshop type session where you could ask 
people to sign up for this and they get Mainpro-C 
credits. They would learn the guideline at the same 
time so there would be an educational component to 
this. {1-1} 

Theme 3: Suggestions for delivering GUIDE-IT: Partic- 
ipants suggested that communication between guideline 
developers and end-users may also be facilitated through 
the consideration of different platforms for delivering 
GUIDE-IT. Some suggested a group-based live forum 
while most believed that an online system (or a wiki- 
based system) would be more efficient as this would 
allow family physicians to contribute to the guideline 
using a central location from their own computer. They 
also suggested that an online system would enable as- 
sessments on different platforms (e.g., smartphones and 
other touch screen devices), which would make assess- 
ments easier to access, and allow more focus on one 
idea (compared with a group situation) and thus would 
also "even out the playing field". 

Discussion 

This qualitative study revealed family physician perspec- 
tives on facilitators and barriers to guideline use across 6 
categories in the context of their own practice. The most 
frequently described facilitators of uptake addressed 
guideline format, content, language and usability. In par- 
ticular, family physicians expressed wanting simple, clear 
and uncomplicated guidelines that are easy to use or fol- 
low, relevant to primary care, and developed by a trusted 
and credible source. These findings are consistent with 
others investigating end-user perspectives of guideline 
implementability in the general context [19-25] and 
across a wide range of specific guideline topics such as 
cancer control [26]; urinary tract infection [27]; depres- 
sion [28]; immunization [29]; infection prevention and 
control [30]; dementia [31]; cholesterol education [32]; 



and asthma [33]; and for different end users such as 
physiotherapists [34] and dentists [35]. Our work builds 
on this knowledge through the creation of a model of 
guideline implementability, derived exclusively from 
guideline end-user perspectives (Figure 2). This model 
represents a more in-depth understanding of the general 
concept of guideline implementability by showing that 
physicians perceive facilitators and barriers to guideline 
uptake almost exclusively according to intrinsic factors 
(i.e., those that are under the control of guideline devel- 
opers). This finding strengthens the notion that optimis- 
ing such factors (as perceived by their end-users) can be, 
and should be applied in tools addressing guideline 
implementability. Whether such a tool can have a posi- 
tive impact, and whether it could be routinely incorpo- 
rated into guideline development at minimal cost will be 
the focus of our future work. 

Family physicians in our study also had the opportun- 
ity to respond to three draft recommendations, which 
highlighted problems typically encountered with guide- 
line use (i.e., lack of understandability and applicability 
of recommendations). Most participants perceived draft 
recommendations as disorganized, wordy and long; had 
difficulty understanding sections they perceived as con- 
fusing or lacked information; and had a general disagree- 
ment with recommendations that were "impractical", 
had poor evidence base, lacked clinical sense or if they 
were perceived as too aggressive (i.e., expectations for 
reaching proposed targets, intervention or monitoring). 
Family physicians were equally open to offering potential 
solutions to improve these recommendations, which in- 
dicates that involving end-users in their assessment dur- 
ing guideline development is not only feasible but shows 
potential for end-users to suggest more implementable 
recommendations. In our study, we were able to show 
the value of such feedback, as participants not only iden- 
tified specific problems, they also provided solutions that 
were practical and operationalized. This level of feed- 
back also suggests that it would be feasible to create ob- 
jective criteria for assessing and revising draft guideline 
recommendations across various factors of guideline 
implementability such as those revealed in our model 
(Figure 2). For example, if we considered the Wording 
factor, we could apply objective rules to identify prob- 
lems with the wording of draft recommendations such 
as its clarity (i.e., unambiguous), simplicity (minimizing 
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multiple steps, elements or actions) and actionability (i.e., 
making recommendations specific and using active voice). 
Through identifying such factors using objective criteria 
across multiple intrinsic factors (i.e., wording, content, 
format, evidence, updating), it would be possible to gener- 
ate domain scores of implementability. This would in 
principle allow potential problems to be identified across 
all domains (or in select domains). Furthermore, the same 
objective criteria that identified the problems in recom- 
mendations can also be used to generate solutions, and 
hence the potential to improve the overall implementibil- 
ity of the guideline. 

Family physicians iterated the importance of their in- 
volvement in guideline development to ensure that de- 
velopers better understand their needs, particularly for 
frontline practice. However, they suggested that those 
tasked with assessing the implementability of draft rec- 
ommendations should comprise mostly of non-academic 
or "regular" (i.e., community) family physicians with no 
particular expertise or interest in a specific disease area. 
Since "regular" physicians are rarely engaged in guideline 
development, participants thought that their involve- 
ment would maximize the objectivity of GUIDE-IT as- 
sessments and the potential that recommendations 
vetted through GUIDE-IT will be more applicable. Such 
engagement can also identify problems with the applic- 
ability and flexibility of guidelines [36,37], which in turn 
will foster greater adherence to guidelines and a sense of 
ownership [27]. Our study participants also thought it 
was important to balance the potential benefits with bar- 
riers such as the potential for delays in completing 
guidelines resulting from this involvement (i.e., complet- 
ing assessments), and the increased costs and resources 
that would be needed to recruit physicians and sustain 
the process. Furthermore, even though most national 
guideline development groups and organizations advocate 
for the involvement of physicians and patients during the 
development process (e.g., Guideline International Net- 
work [GIN], Canadian Task Force on Preventive Health 
Care [CTFPHC]; Institute of Medicine [IOM]; and the Na- 
tional Institute for Health and Care Excellence [NICE]), 
most do not provide information about which specific end- 
users should be involved, how they should be selected or 
recruited, when they should be involved and how [38-41]. 

Lastly, participants had the opportunity to provide 
feedback on the conceptual GUIDE-IT tool. They sug- 
gested that an individualized online platform would be 
the most practical forum to deliver GUIDE-IT assess- 
ments. They believed that a computerized system would 
provide more flexible participation and easier access to 
completing recommendation assessments, including the 
delivery of GUIDE-IT using diverse platforms such as 
applications for smartphones and other touch screen 
devices. 



One of the strengths of our study was that we ad- 
dressed the potential limitations inherent to qualitative 
studies such as threats to internal validity (i.e., credibil- 
ity), external validity (i.e., transferability) and reliability 
(dependability) [42]. We addressed potential threats to 
credibility by pilot testing the interview questions to en- 
sure that they were well understood, and to use experi- 
enced moderators to lead discussions. As with other 
qualitative studies, our findings are not generalizable be- 
yond the sample of family physicians that participated in 
our study. However, we used a mixed sampling strategy 
(random and purposive) in an attempt to identify a wide 
scope of family practice. Furthermore, we provided de- 
tailed information about the family practices and physi- 
cians to enhance the transferability of our findings. To 
limit the potential of biases that may be introduced by 
investigators with respect to the dependability and con- 
firmability of our work, we standardized procedures, 
methods, and analysis strategies across all interviews. 
Furthermore, sessions were planned so that physicians 
were prompted about their perceptions of the facilitators 
and barriers to guideline implementability in the context 
of their own practice before introducing the conceptual 
design of our GUIDE-IT tool, thereby avoiding any op- 
portunity for contamination. Finally, we believe that our 
findings are transferable to community and academic 
family practices in the Toronto general area. 

Next steps include applying the findings of this study 
(in consultation with information technologists and hu- 
man factors engineers) to transform the conceptual 
GUIDE-IT design into a functioning prototype. This will 
involve creating GUIDE-IT as an online system that will 
be accessible through multiple applications and devices, 
and the development of a systematic, operationalized, 
and sustainable approach for selecting and recruiting 
family physicians for completing GUIDE-IT assessments. 
For example, we will attempt to optimise strategies for 
family physician involvement in the use of GUIDE-IT by 
balancing identified resource and time burdens that may 
delay guideline production. Once the prototype is final- 
ized, we will test it with guideline developers and all 
relevant end-users (all physicians who use guidelines) to 
determine its usability for assessing the implementability 
of guidelines. Next, we will conduct a randomized trial 
to determine the impact of GUIDE-IT on improving 
guideline recommendations and its impact on subse- 
quent guideline use by family physicians. 

Conclusions 

Our study identified facilitators and barriers from the 
perspective of guideline end users that will be used to 
transform our GUIDE-IT tool into a functional proto- 
type. Our findings build on current knowledge of guide- 
line implementability by showing that family physicians 
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perceive guideline uptake mostly according to factors 
that are in the control of guideline developers. The study 
also identified numerous intrinsic barriers that could be 
minimized during guideline development if developers 
elicit them from potential end users. Finally, it highlights 
the importance of end user feedback and the willingness 
of end users to provide feedback in order for developers 
to produce more implementable products. Characterization 
of facilitators and barriers can be used to optimize tools 
and interventions such as GUIDE-IT to overcome barriers 
and improve guideline uptake. 

Additional files 



Additional file 1: Semi-structured Interview Guide. 

Additional file 2: Draft guideline recommendations used to elicit 
feedback from family physician participants during interview 
sessions*. 
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